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By introducing a new stochastic integral, we investigate the energetics of classical stochastic 
systems driven by non-Gaussian white noises. In particular, we introduce a decomposition of the 
total-energy difference into the work and the heat for each trajectory, and derive a formula to 
calculate the heat from experimental data on the dynamics. We apply our formulation and results 
to a Langevin system driven by a Poisson noise. 
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INTRODUCTION 



Stochastic processes driven by non-Gaussian noises have been shown powerful to analyze various natural and social 
phenomena; the shot noise in electrical circuits JH, Levy flights of bumblebees 0] and human mobilities, [2$, and 
random walks in finance and econophysics [3, H|7 Moreover, non-Gaussian effects have been discussed for small 
thermodynamics systems such as biological molecular machines. For example, a non-Gaussian white noise has been 
used for modeling directed transport in Brownian motors 0,0]; and the Adenosine-triphosphate (ATP) reception by 
red-blood-cell membranes [1, Q has been modeled in terms of non-Gaussian noises. This Letter aims to introduce a 
new stochastic integral for non-Gaussian processes and, to apply it to small thermodynamic systems. 

Recent progress in experimental technique causes growing interest in small thermodynamic systems (lp| . In such 
systems, thermodynamic quantities become stochastic due to environmental fluctuations that can be non-Gaussian. 
The thermodynamic energy balance in a single trajectory has been formulated by stochastic energetics (llj . in which 
thermodynamic quantities such as work and heat are defined for each trajectory Stochastic energetics has been 
widely applied to theories 13-22| and experiments (23l - [28| of modern nonequilibrium statistical mechanics. 

For Gaussian processes, it has been established that the Stratonovich-type stochastic calculus is consistent with the 
stochastic energetics Uj. In fact, the Stratonovich calculus has been used for experimental and numerical verifications 
of nonequilibrium equalities such as the fluctuation theorem US-HI. This is because the ordinary differential calculus, 
such as the chain rule df/dt = (df /dx)(dx/dt), is satisfied for the Stratonovich stochastic calculus. In contrast, the 
Ito-type stochastic calculus needs an alternative formula, which is known as the ltd rule, instead of the ordinary 
chain rule. So far, however, stochastic energetics for non-Gaussian processes has not been fully investigated. It is 
remarkable that, as will be shown later, the Stratonovich calculus is inadequate to formulate the stochastic energetics 
for non-Gaussian processes. 

In this Letter, we introduce a new stochastic integral, with which the ordinary differential calculus is applicable to 
non-Gaussian processes. Based on it, we investigate the decomposition of the total-energy difference into the work 
and the heat for each trajectory, and derive a formula that is applicable to measurements of the heat in experiments. 
We show that our stochastic energetics is consistent with the first law of thermodynamics. 



STOCHASTIC INTEGRALS 

Let be a white noise with = and (£(0£( s )) = S(t — s), where the bracket denotes the ensemble average 

of a stochastic variable. We consider a stochastic differential equation dX{t)/dt = a(X(t)) + b(X(t))£(t), where X(t) 
is the phase-space point of a Brownian particle, and a(X(t)), b(X(t)) are arbitrary functions of X(t). The stochastic 
differential equation can be rewritten as the integral form X(t) = X a + f Q dsa(X(s)) + f Q ds£(s)b(X (s)) , where the last 
term on the right-hand side (rhs) involves a stochastic integral. In usual stochastic calculus for Gaussian processes, 
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FIG. 1: A schematic of the e-smoothing. 
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we use one of the following two definitions: 
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where the symbols • and o denote the Ito calculus and the Stratonovich one, respectively, and At = t/n, ti = iAt, Xi = 
X(ti). The term At£(ti) is shorthand for AW{U) = W(t i+1 ) - Wfc), where W(t) = J* ds£(s) is the Wiener process. 

Our strategy to define the new stochastic integral for non-Gaussian processes is the white noise limit of a non- 
Gaussian colored noise. First, we construct the colored noise by using white noises. Let e be a time constant to 
characterize the correlation time of the noise, and let At^(U) be shorthand for AL{U) = L(U+i) — L{U), where 
Lit) = f Q ds£(s) is the Levy process. We define the colored noise: 
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where I = e/ At is assumed to be an integer. The correlation of the noise satisfies ^£ e (t)£ e (s)y = only if \t — s| > e. 

We call this manipulation e-smoothing. For example, the white Poisson noise £(t) = 6(t — U), where each Poisson 
flight happens at ti, is used to construct the colored noise as shown in Fig. 1. 

Introducing a new symbol *, we propose the following stochastic integral for non-Gaussian processes as a limit of 
the colored noise: 



/ ds£(t)*f(X(t))= lim lim V At£ e (U) f (X (U)) , 



(4) 



where f(x) is an arbitrary function. We refer to this integral as the ^-integral or the *-calculus. Correspondingly, we 
interpret the stochastic differential equation with the ^-integral as 



dX(t) 
dt 



a(X(t)) + b(X(t))*£(t). 



(5) 



The two limits in Eq. (jlj are not commutable. In the Ito integral, the limits are taken simultaneously At = e — > +0. 
On contrary, the limit of At — ¥ +0 is taken before the limit of e — > +0 in our formulation. We note that our integral 
is equivalent to the Stratonovich one for Gaussian processes [3(| ■ 

Next, let us discuss the transformation formula from the ^-integral to the Ito one. By using Hanggi's functional 
formula [35l . l36| , we obtain (see supplementary material for a derivation) 



dL(t)*f(X(t)) = J2 



dL n+1 (t) 



- (n + 1) 



K^J ,/v> 



(6) 



--X(t)J 



where b(X(t)) describes the same function in Eq. ([5]), and f(X(t)) is an arbitrary function of X(t). For Gaussian 
processes, Eq. ^ reduces to the transformation formula from the Stratonovich integral to the Ito one, because dL n = 
holds for n > 3. Although other types of e-smoothing can be used to construct the colored noise, Eq. © does not 
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FIG. 2: (Color online) Numerical results on the consistency between Eq. (0 and Y.We fix the variance of the Poisson noise 
A/ 2 = 4.0 and simulate the equation until t = 1.0 with e = 0.001. As I increases, the difference betweent the *- and the 
Stratonovich integrals becomes significant. In the Gaussian limit of I —¥ 0, Z is expected to equal unity in the both calculuses 
as denoted by an open circle. 



depend on the way of the e-smoothing . We note that Eq. © can be regarded as a straightforward generalization 
of the result in Refs. 3l|, l32|, in which Eq. ([5]) has been transformed into the Ito type. 

As a simple example, we apply the *-calculus to the Black-Scholes equation driven by a Poisson noise [29| 



(7) 



where £ = fj — XI with a Poisson noise r) characterized by its intensity / and transition rate A. The Poisson noise is 
a typical non-Gaussian noise. In fact, any noise can be decomposed into the combination of Gaussian and Poisson 
noises [33J. If we define £A" on the rhs of Eq. ([7]) based on the ^-integral as £ * X, then the solution of Eq. ([7]) equals 

the following quantity: Y = exp — t + J Q ds^(s) , which is the formal solution of the Black-Scholes equation with 

the ordinary differential calculus. In contrast, if we adopt the Stratonovich integral to define the rhs of Eq. ([JJ, its 

solution does not equal Y. Figure [5] shows the numerical results on Z = (y/X^ for the cases of the ^-integral and 

the Stratonovich one. The e-smoothing is performed by the definition Eq. ([3]). As I increases, Z becomes different 
from 1 for the Stratonovich integral due to the non-Gaussian property of the noise. In contrast, the *-calculus keeps 
Z w 1 independently of the value of /. We also note that the result of the Ito calculus is ranged around Z — 5. These 
results imply that neither Ito nor Stratonovich calculus is obtained as the white noise limit of a colored noise. 



STOCHASTIC ENERGETICS FOR NON-GAUSSIAN PROCESSES 



We now apply the ^-integral to formulate stochastic energetics for non-Gaussian processes. Let us consider the 
following underdamped Langevin equations 



dp 
~dt 



7 „ dU(a, x) 
rrJ > dx 



+ g(x,p)*£, — = —, 
dt m 



(8) 



where £ is a non-Gaussian noise whose mean value is zero, x is the position of the particle, p is its momentum, and 
U{a,x) is the potential with an external parameter a, such as the intensity of optical tweezers. If g{x,p) is constant, 
the noise is called additive. Otherwise, it is called multiplicative. It is known that Brownian motion near a wall can 
be characterized by a multiplicative noise (3^. The detailed balance condition is not assumed in this Letter, and 
the following results can be applied to athermal systems. We note that the detailed balance condition in athermal 
systems has been studied in Ref. [39|. 

Let us first define the thermodynamic quantities for each trajectory. We divide the total-energy difference into the 
following two parts 



oa 



da, dQ = - 



ip 2 . £*g{x,p)p 



dt, 



rn 



(9) 
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where W is the mechanical work through the parameter a, and Q is the energy flow induced by the microscopic 
degrees of freedom in the environment. The usual heat is included in Q. Our formalism has practical utilities for 
experimental and numerical data analysis of the heat. We call Q as "heat" for convenience. By using the ordinary 
chain rule for the ^-integral, we confirm the first law of thermodynamics: 

d E = ^- + ^*dx + ^da = dQ + dW, (10) 
m Ox Oa 

where E = p 2 /2m + U (a, x) is the internal energy of the particle. 

We next derive a representation of the average heat flux by using the *-calculus. For this purpose, we first write 
down the Kramers equation for P(x,p,t) = (p(x,p,t)^ with V(x,p,t) = 6(x — x(t))5(p — p(t)). The stochastic 
Liouville equation [34^ is given by 

t) + * Hw, t)} + ^-m) * v{x )P , t)} = o, 

where the stochastic partial differential equation is regarded as the *-calculus. Taking average of this equation and 
using the transformation formula ([5]), we obtain the generalized Kramers equation 



dt dx Vm ) dp 



m ox 



(11) 



where * gVj describes the diffusion of the particle. Transforming this diffusion term into the Ito type, we reproduce 
the ordinary Kramers equation. By introducing 



m \ m 



we rewrite (|TT|) as the conservation of the probability dP/dt + dJ x /dx + dJ p /dp = 0. Note that the probability fluxes 
include infinite number of differentiations if we use the Ito calculus. The probability-conservation formula leads to a 
simple identity of the total derivative for any function f(x,p,a): 

d f(x,P,a))= [ dxdp[^-J x + ^-jA +d/|A. (13) 



t dt ' I J \dx dp J \da 

Taking f(x,p,a) as E(x,p,a), we derive that the heat satisfies formula of the average of heat flux 

I dQ\ f , , fdE dE \ 



\ dt I J \dx dp 

We note that we can straightforwardly apply the ^-calculus to the overdamped Langevin equation. 

HEAT MEASUREMENT FORMULA 

In the case of the underdamped Langevin equation driven by an additive non-Gaussian noise, the transformation 
formula Eq. ([5]) can be reduced to 

dQ = -7^ dt + dL*l = -^dt + dL.l + ^. (15) 

This formula can be applied to measurements of the heat in experiments, because Eq. © includes the noise term 
up to only the second order. The term (dL) 2 is not deterministic but stochastic, contrary to the cases of the 
Gaussian noise, in which (dL) 2 can be replaced by a 2 dt with the variance a. We note that the formula for the heat 
measurement becomes more complicated for multiplicative noises. We also note that the heat measurement formula 
for the overdamped Langevin equation is not simple even for additive noises, where higher order cumulants appear 
for the cases of a non- harmonic potential [37j . 
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FIG. 3: (Color online) The check of the first law of thermodynamics through the numerical solution of Eq. (|16|l with the 
intensity I = ±2.0, where the Poisson noises are added at r = 1.0 and r = 2.0. The result of U* based on the *-calculus agrees 
with the total energy U, while U s based on the Stratonovich calculus is different from U. 



A MODEL OF ATP RECEPTION 




To demonstrate how a non-Gaussian feature appears in a stochastic process, let us analyze a Brownian particle in 
an ATP bath. When the particle receive an ATP, the particle suddenly moves. We assume that the particle obeys the 
overdamped Langevin equation under a non-harmonic potential U(x) — (k/2)x 2 + (e/4)x 4 with small e. The system is 
driven by an additive Poisson noise whose transition rate P(x — ¥ y) is given by P(x — > y) = A/2 (if x — y — ±1/7), 
(otherwise), where / is the intensity of the Poisson noise and 7 is a friction constant. We note that the detailed 
balance condition is violated in this model. The dimensionless Langevin equation of this system is given by 

" Y = -X - iX 3 + I, dl = £dr, (16) 

^ (n: odd), 

(tp/t s ) n ^ 2 1 dr (n: even), 

where we introduced the characteristic constants and dimensionless parameters as < s = j/k,t p = 1/A, x s — 
(I /l)\/(ts/tp),e — x 2 e/k,x — x s X, and t = t s T. Note that t s and t p are the characteristic time scales of the re- 
laxation of the system and the Poisson noise, respectively, and therefore t p /t s characterizes non-Gaussian effects. By 
analyzing this model, we demonstrate that ^-integral is consistent with the first law of thermodynamics and that the 
non-Gaussian effects are relevant for t p ~ t s . 

We first demonstrate that the first law of thermodynamics is consistent with the *-calculus in this system. Let us 
define the three types of dimensionless energies U = 4p + U* = J Q T dX(s) * U s = dX(s) o where U 
is the total potential energy, U* is the heat with the *-calculus, and U s is that with the Stratonovich calculus. We 
note that the work is zero in this case. Figure 3 shows the time evolution of the three quantities without taking the 
ensemble average, where U* is consistent with the first law of thermodynamics while U is not. 

We next derive the condition where non-Gaussian effects are relevant. The average of the energy in the steady 
state can be obtained for small e as lim r _ ) . 00 {^C/^ = 1/4 — 3e/16 — (e/16) (t p /t s ) . This implies that we cannot ignore 

the non-Gaussian effect for t p ~ t s , while the non-Gaussian effect vanishes for t s 3> t p . In fact, t p is the relaxation 
time in which the Poisson noise converges to a Gaussian noise according to the central limit theorem. For t p ~ t s , 
the system evolves before the relaxation, and therefore we cannot replace the Poisson noise by a Gaussian noise. In 
contrast, we can adiabatically eliminate the non-Gaussian effect in the Poisson process for t s ^> t p . 



CONCLUSION 



In this Letter, we have developed the stochastic energetics of small thermodynamic systems driven by a non- 
Gaussian noise, by introducing the new stochastic integral (|4]) which we refer to as the *-integral. The investigation 
of the second law of thermodynamics and fluctuation theorem for non-Gaussian processes is a future issue, in which 
the *-calculus would play an important role. 
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SUPPLEMENTARY INFORMATION: THE TRANSFORMATION FORMULA FROM THE *-INTEGRAL 

TO THE ITO INTEGRAL 



We consider the following Langevin equation 

dX(t) 
dt 



= a(X(t)) + b(X(t))*i(t), 



(18) 



where a(X (t)) , b(X (t)) are arbitrary functions of X(t) and is a non-Gaussian white noise. Let f(X(t)) be an 
arbitrary function of X(t) and let L(t) = J Q ds£(t) be the Levy process. Here we prove Eq. (6) of the main text. 
We have formulated the ^-calculus as the white noise limit of a colored noise. We use Hanggi's functional formula 35, 
for stochastic processes driven by a colored noise, and obtain 



1 



n = l 



(v(t)g[i]\) = ^2 ~ / ds 1 . . .ds n C n+ i{t,s 1 , . . . ,s n ) 



S n g[ 



Sfj(si) . ..Sfj(s n ) 



(19) 



where fj is a colored noise, g[fj] is an any functional of ?), and C n +i(t, si, . . . , s n ) is a (n + l)-point cumulant function 
defined by 



Sv(s)Sv(si) . . . Sv(s n ) 



1 d 

v(t) dt 



$[u] = log 



exp I i / dsv(s)fj(s) 



(20) 



We note that f(X(t)) is a functional of fj because X(t) is a functional of r). We substitute fj and g[fj] with ^ e and 
f{X(t)) respectively, and take the limit of e — > +0. We then obtain 



i(t) * f(X(t))) = £ fim o (LW(X(t))) = £ ( Ux)± ) /(,) 

n— \ 



(21) 



x=X(t)l 



where C n — (dL n (t)/dt), or equivalently, 



°° (dL n+1 (t) 
(dL(t)*f(X(t)))=J2 



(rc+1)! 



x=X(t)l 



(22) 



It is remarkable that the averages of dL n (t) and X(t) in the right-hand sides (rhs') of Eqs. (|2"Tj) and (1221) are decoupled. 
This is known as the non-anticipating property, which is an intrinsic character of the Ito integral [291 ] . Therefore, the 
rhs of Eq. (|22|) can be written in the Ito form as 



71=0 



(n+1)! 



(23) 



=X(t)l 



We can remove the averaging operator (...) because this equation holds for an arbitrary function f(x), and obtain 



dm * Jim = ± . n b(x) d_ } m 



x=X(t) 



3 dL(t)-b(x)Jk - 1 



(24) 



x=X(t) 



which implies Eq. (6) of the main text. 
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